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Abstract 


This  report  concerns  the  effects  of  response  modality  and  the 
relation  between  stimulus  dimensions  on  subjects'  ability  to 
report  one  dimension  of  a  multidimensional  stimulus.  Subjects 
were  asked  to  report,  as  rapidly  as  possible,  either  the  name  or 
the  ink  color  of  colored  words.  The  relation  between  the  ink 
color  and  word  was  either  congruent  (Blue  in  blue  ink),  neutral 
(Door  in  blue  ink),  or  incongruent  (Blue  in  red  ink).  Responses 
were  made  either  manually  or  vocally. 

Results  are  consistent  with  previous  findings  in  the  area  of 
Stroop  (Stroop^  1935)  research.  That  is,  responding  to  one  of  two 
-  dimensions  is  more  difficult  when  the  relation  between  dimensions 
is  incongruent  than  when  the  relation  between  dimensions  is 
congruent  or  neutral.  But  in  addition,  results  show  that  no 
interference  from  an  incongruent,  ink-color  dimension  results  when 
subjects  respond  vocally  to  the  word  dimension,  whereas  when 
subjects  respond  manually  to  this  dimension,  the  incongruence 
between  the  colors  and  word  produce,  interference.  Results  suggest 
a  limitation  on  the  usefulness  of  a  color  dimension  when  a  word 
dimension  requires  a  speeded-speech  response.  f  _ 


Accesion  For 

\ 

NTIS  CRA&I 

V 

DTIC  TAB 

n 

.  Unannounced 

□ 

Justification 

By... 

Dist.  ibution  / 

AvaiiabiJity  Codes 

Dist 


Avail  and/or 
Special 


The  Effects  of  Response  Modality  on  Interference 
Between  Stimulus  Dimensions. 

V.  Grayson  Cuqlock  and  Kathryn  A.  Bloem 

In  an  effort  to  increase  the  amount  of  information  conveyed 
by  one  element  on  a  display,  many  designers  routinely  used  two  or 
more  physical  dimensions  of  one  element  to  provide  different  types 
of  information.  For  Instance,  the  color  of  a  word  can  be  used  as 
a  code,  perhaps  Indicating  the  status  of  some  equipment,  while  the 
word  itself  can  be  used  to  Identify  the  equipment.  The  present 
report  will  discuss  an  experiment  which  illustrates  when  the  use 
of  a  color  code  as  a  redundant  dimension  should  be  avoided. 
Background 

The  basis  for  this  experiment  was  a  need  to  determine  how  the 
type  of  relation  between  stimulus  dimensions  differentially 
affects  reaction  times  for  speech  and  manual  responses.  Previous 
research  has  shown  that  speech  responses  are  faster  than  manual 
responses  if  the  ink.  and  word  dimensions  of  a  colored  word  are 
dissimilar  (Simon  and  Sudalaimuthu,  1979).  Further,  several  other 
studies  have  offered  converging  evidence  that  the  use  of  one  of 
two  dimensions,  word  or  ink  color,  is  affected  by  the  congruence, 
the  degree  of  semantic  agreement,  between  the  dimensions  (Dunbar 
and  MacLeod,  1984;  Virzl  and  Egeth,  1985). 

For  Instance,  the  typical  finding  of  research  using  the 


Stroop,  Color-Word  Interference  Test  (Stoop,  1935)  is  that 
reaction  times  for  naming  the  ink  color  of  words  that  are  color 
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names  are  longer  than  reaction  times  for  naming  the  ink  color  of 
words  that  are  not  color  names  (Wheeler,  1977;  Williams,  1977). 
Christ  (1975;  1983)  has  cited  many  studies  that  Indicate  that  the 
usefulness  of  the  color  dimension  in  providing  information  depends 
on  its  relation  to  the  non-color  dimension.  In  light  of  the  above 
results,  several  results  appear  likely  under  various  combinations 
of  dimensional  relations  and  response  types. 

Before  stating  the  experimental  rationale  we  must  make 
explicit  the  definition  of  lncongruent  relations.  We  define 
lncongruent  relations  as  those  relations  between  dimensions  of  a 
stimulus  that  result  when  the  dimensions-  represent  two  different 
examples  from  the  same  semantic  category.  For  Instance,  consider 
the  catagory  of  color;  both  the  color  blue  and  the  name  "blue"  are 
from  the  same  semantic  catagory  (colors)  and  are  both  examples  of 
the  same  specific  color;  these  are  congruent  relations.  By 
contrast,  the  color  green  and  the  name  "blue”  are  also  from  the 
same  semantic  catagory,  but  are  not  examples  of  the  same  color; 
blue  is  not  green.  Therefore,  the  word  green  written  in  blue  ink 
represents  an  lncongruent  relation  between  the  two  stimulus 
dimensions,  word  and  ink  color. 

By  this  definition,  non-color  (neutral)  words  cannot  produce 
incongruency  when  printed  in  various  colors  of  ink  because  they 
are  from  a  different  semantic  catagory.  Furthermore,  words  and 
ink  colors  that  are  identical  cannot  result  in  incongruency 


because  they  are  semantically  alike  in  specific  example,  even 
though  different  dimensions  are  represented. 

Experimental  Rationale 

Consider  as  a  first  premise  that  there  is  a  hierarchy  of  how 
words  written  in  colors  are  processed.  In  this  hierarchy,  people 
process  words  before  colors.  (See  Kahnemanand  Chojczyk  (1983)  for 
evidence  that  supports  this  premise.)  A  second  premise  is  that 
interference  between  dimensions  can  be  avoided  when  selective 


attention  to  one  is  required.  If  the  processing  time  for  that 
dimension  is  shorter  than  that  of  the  irrelevant  dimension,  the 
relevant  dimension  can  be  processed  and,  more  important,  responded 
to  before  the  irrelevant  dimension.  It  is  well  documented  that 
naming  words  is  faster  than  naming  colors  (Morton  and  Chambers, 
1973;  Posner  and  Snyder,  1973)  and  that  the  Stroop  effect  is 
asymmetrical  unless  some  experimental  manipulation  has  slowed  down 
the  processing  of  the  word  dimension.  For  instance,  Dunbar  and 
MacLeod  (1984)  conducted  several  experiments  in  which  they  slowed 
the  processing  of  the  word  and  found  that  the  ink  color  interfered 
with  naming  the  word,  the  "Reversed  Stroop  effect." 

A  third  premise  is  that  interference  can  be  further  reduced 
if  the  compatibility  between  stimulus  and  response  for  the 
relevant  dimension  is  more  than  the  compatibility  between  stimulus 
and  response  for  the  irrelevant  dimension.  This  greater 
compatibility  enables  the  processing  and  responding  to  the 
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relevant  dimension  to  occur  more  efficiently  with  little  or  no 
interference  from  the  Irrelevant  dimension. 

No  interference  from  an  lncongruent,  irrelevant  dimension 
should  occur,  then,  if  the  processing  of  the  relevant  dimension  is 
higher  in  the  hierarchy  than  the  irrelevant  dimension  and  if 
responding  to  that  dimension  is  more  compatible.  These  premises 
imply  something  else.  If  people  have  to  respond  quickly  to  the 
word  dimension  of  a  color-coded  word  and  can  do  so  easily,  the 
information  from  the  code  may  not  be  of  any  practical  benefit. 

That  is,  the  processing  of  the  code  information  is  so  much  slower 
than  that  of  the  word  that  the  response  to  the  word  is  made  prior 
to  the  completion  of  the  processing  of  the  color.  Thus  color 
processing  is  completed  too  late  to  benefit  responding  to  the  word 
on  any  given  trial.  This  report  will  discuss  an  experiment  which 
provides  support  for  this  hypothesis. 

Method 

Design.  A  four-factor,  mixed  design  was  used  to  measure  how 
reaction  times  are  affected  by:  (a)  the  type  of  relation  between 
the  word  and  the  color  dimension  (Type),  (b)  which  dimension 
(color  or  word)  is  relevant  for  the  response  (Dimension),  (c)  the 
type  of  response,  speech  or  manual,  required  (Modality),  and  (d) 
the  ordering  of  the  exposure  to  the  Modal ity/Dlmens ion 
combinations  (Groups).  There  were  four  combinations  of  response 
modality  and  relevant  dimension,  one  of  the  four  was  seen  by  each 
subject.  The  four  combinations  are  manual-word  (MW),  manual-ink 
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(MI),  speech-word  (SW)  and  speech-ink  (SI).  Each  group  received 
one  of  Che  following  four  sequences  of  the  four  combinations:  (1) 
MW->  MI->  SW->  SI,  (2)  MI->  MW->  SI->  SW,  (3)  SW->  SI->  MW->  MI, 
or  (4)  SI->  SW->  MI->  MW. 

There  were  four  levels  of  stimulus  types: 

1.  Neutral  —  The  word  used  was  neither  congruent  nor 
incongruent  with  the  color  of  the  ink  in  which  it  was  printed  (for 
example,  the  subject  saw  DOOR  in  red  ink). 

2.  Congruent  —  the  word  and  the  ink  color  were  the  same. 

3.  Incongruent  —  relevant  and  Irrelevant  dimensions  of  the 
stimuli  were  both  colors,  but  not  the  same  color. 

4.  Doubly  Incongruent  —  the  irrelevant  dimension  for  the 
first  colored  word  and  the  relevant  dimension  for  the  second 
colored  word  of  consecutive  words  were  identical  (for  Instance, 
BLUE  in  green  ink  followed  by  RED  in  blue  ink).  In  addition,  the 
relevant  and  Irrelevant  dimensions  of  any  given  word  were  both 
colors,  but  not  the  same  color. 

Task.  The  task  was  an  unpaced  Stroop  task.  The  subject  saw 
individual  words  written  in  different  colors  of  ink.  Sometimes 
the  words  named  colors  (red,  green,  blue,  or  yellow)  and  at  other 
times  they  named  objects  (car,  front,  door,  or  load).  The 
subjects  responded  with  a  manual  key-press  or  a  speech  response  to 
either  the  color  of  the  ink  in  which  the  word  was  written  or  the 
word  itself  for  a  block  of  40  trials  for  each  of  the  four 


dimension/modality  combinations,  for  a  total  of  160  trials  for 
each  subject. 

If  the  subject  saw  the  stimulus  RED  written  in  blue  ink,  the 
correct  response  would  be  "blue"  if  the  relevant  dimension  was  ink 
color  and  “red”  if  the  relevant  dimension  was  the  word.  The 
subject  was  told  before  each  block  of  trials  which  dimension,  the 
ink  or  the  word  itself,  was  relevant  and  which  response  modality, 
speech  or  manual,  was  required.  At  the  end  of  each  trial  the 
subject  was  told  the  number  of  correct  responses  out  of  forty  and 
the  average  of  the  reaction  times. 

The  words  were  displayed  for  2  s  or  until  the  subject  made  a 
response.  If  the  subject  did  not  respond  within  the  2-s  interval, 
the  stimulus  was  erased  and  the  display  was  blank  until  a  response 
was  made. 

Subjects.  Sixteen  male  and  female  civilian  subjects  from  Morgan 
State  University  and  Aberdeen  Proving  Ground  in  Maryland 
participated  in  the  experiment  (8  males  and  8  females).  The 
subjects  were  18  years  old  or  older  and  were  without  anomalous 
color  defects.  Each  subject  was  paid  $15.00  for  participating  and 
the  subject  with  the  best  task  performance  was  paid  a  bonus  of 
$10.00. 

Apparatus .  A  Timex-Sinclair  2068  microcomputer  was  used  to 
generate  the  stimuli  and  record  the  responses  for  this  experiment. 
All  stimuli,  were  displayed  on  a  Panasonic  color  display  monitor 
(model  CT-1310M).  Reaction  times  for  the  vocal  responses  were 
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recorded  by  the  computer  via  a  voice-activated  relay  unit 
connected  through  one  of  the  ports  of  the  computer. 

Manual  responses  were  made  by  pressing  the  appropriate  key  of 
the  board;  subjects  used  the  same  four  keys  for  making  responses 
in  all  conditions.  Speech  responses  were  recorded  by  the  computer 
using  the  voice  activated  relay  diagrammed  in  Figure  1.  The  gain 
of  its  amplifier  and  threshold  level  controls  were  adjusted  to  fit 
the  talker’s  speech  level  so  that  reliable  triggering  occured  as 
soon  as  possible  for  the  word  responses. 

Resulta 

Analysis 

A  constant  of  100  milliseconds  was  added  to  the  speech 
reaction  times  to  adjust  for  the  amount  slower  the  manual  RTs  were 
than  the  speech  reaction  times;  this  100  msec  difference  was 
determined  during  a  pilot  study  using  a  separate  group  of  twenty 
subjects.  Without  this  adjustment  the  main  effect  of  modality  was 
significant;  however  it  should  be  noted  that  with  or  without  the 
adjustment  the  same  data  —  the  interactions  involving  modality  — 
would  be  the  focus  of  comment,  not  the  main  effect  of  modality. 

The  reaction  times  data  did  not  meet  the  sphericity 
assumption  required  for  the  fixed-effects  analyses  of  variance. 
Therefore,  a  multivariate  analysis  of  variance,  with  one 
dependent  measure,  was  used;  see  O’Brien  and  Kaiser  (1985)  for  a 
description  of  the  use  of  MANOVA  for  analyzing  repeated  measures 


Output  buffer 
transistor  to  drivs 
computer  input 


Non-Inverting  Inverting  AmpSfier  Differential  Comparator  One-Shot  Multivibrator 
AC  amplifier 


Figure  1.  The  voice  activated  relay  used  to  measure  the  speech 
reaction  tines. 
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data.  Initially  this  analysis  Included  the  four 
modality/dimension-sequences  as  the  be  tween-subjects  factor 
(Groups)  to  test  for  order  effects.  This  factor  was  not 
significant,  and  no  interactions  Involving  this  factor  were 
significant.  Therefore,  another  MANOVA  was  run  in  which  the  data 
were  collapsed  across  the  groups  factor. 

Plndings 

Consistent  with  previous  Stroop  research,  the  results  of  this 
study  show  a  significant  effect  of  the  type  of  relation  between 
dimensions  (Type)  on  the  reaction  times,  £(3,13)  -  22.62,  £<.0001. 
The  Tukey  honestly  significant  difference  (HSD)  test  was  conducted 
to  determine  which  differences  among  types  were  significant;  the 
results  indicated  that  both  incongruent  types  produced  more 
Interference,  as  measured  by  an  Increase  in  reaction  times,  than 
the  neutral  and  the  congruent  types.  There  was  no  significant 
difference  between  the  congruent  and  neutral  types,  nor  the  two 
Incongruent  types. 

Also  consistent  with  Stroop  research,  the  dimension  main 
effect  was  significant.  That  is,  reaction  times  for  naming  the 
words  were  shorter  than  reaction  times  for  naming  the  ink  colors, 
F(l,15)  -  11.56  p<.004.  There  was  a  significant  Dimension  by 
Type  Interaction,  £(3,  13)  •  4.38  £<.02;  although  incongruent 
relations  Increased  reaction  times  for  both  the  ink  and  the  word 
dimensions.  Incongruence  had  a  much  greater  Impact  when  the  ink 
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dimension  was  named  Chan  when  Che  word  dimension  was  named. 

Figure  2  illustrates  this  interaction. 

The  modality  main  effect  was  not  significant,  but  the 
Modality  by  Dimension  Interaction  was  significant,  F(l,  15)-  32.23 
£<.0001.  As  shown  in  Figure  3,  if  subjects  make  a  manual 
response,  it  did  not  matter  whether  the  relevant  dimension  was  ink 
or  word.  But  if  subject  made  a  speech  response,  there  was  a  large 
decrease  in  reaction  times  for  naming  the  word  compared  with 
naming  the  ink  color. 

The  most  noteworthy  finding  of  this  study  is  the  significant 
Modality  by  Dimension  by  Type  Interaction,  F(3,13)  -  4.62,  £<.02. 
As  can  be  seen  in  Figure  4,  the  type  of  relation  between 
dimensions  of  a  colored  word  had  a  strong  effect  on  reaction  times 
if  either  a  manual  response  was  made  for  either  dimension,  or  if 
the  subject  vocally  reported  the  ink  color.  But  if  a  speech 
response  was  required  for  the  word  dimension,  the  Incongruence  had 
essentially  no  effect  on  the  time  it  took  to  name  the  word. 
Accuracy 

The  number  correct  (accuracy)  was  only  of  interest  to  this 
study  in  determining  whether  there  was  a  trade-off  between  speed 
and  accuracy.  The  analysis  of  the  main  effects  and  interactions 
showed  no  evidence  of  this  type  trade-off.  Subjects  were 
accurate;  the  range  across  subjects  was  90%  to  97%  correct  for  all 
conditions.  The  mean  percentage  correct  for  each  condition  are 
given  in  Table  1. 
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Figure  2.  The  mean  reaction  times  for  each  of  the  four  stimulus 
types,  for  both  the  ink  and  word  relevant  conditions,  summed  across 
response  modality. 
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Figure  4.  The  mean  reaction  times  for  the  four  stimulus  types, 
shown  separately  for  the  four  dimens ion/modality  combinations  — 
manual  word,  manual  ink,  speech  word,  and  speech  ink. 
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Table  1 


Mean  Percent  Correct  for  each  Stimulus  Type,  Dimension  and  Modality 

Neutral 

Congruent 

Incongruent 

Doubly 

Incongruent 

Discussion 

The  results  of  this  study  suggest  that,  when  processing 
color-coded  words,  the  effects  of  the  processing  of  the  Irrelevant 
dimension  affects  performance  only  if  the  normal  processing  time 
of  the  relevant  dimension  is  slower  than  that  of  the  Irrelevant 
dimension.  For  example,  the  Impact  of  Incongruent  relations  was 
much  stronger  when  the  ink  (a  more  slowly  processed  dimension  than 
word)  was  relevant  than  when  the  word  was  the  relevant  dimension. 
Likewise,  if  task  demands  change  the  processing  time  of  the 
relevant  dimension  so  that  it  becomes  slower  than  the  processing 
time  of  the  irrelevant  dimension  (such  as  when  a  manual  response 
is  required  for  a  word)  then,  too,  the  more  dramatic  effects  of 


the  Irrelevant  distension  will  result.  The  results  o£  this  study 
are  consistent  with  this  model. 

The  usual  effect  of  the  type  of  relation  between  distensions 
was  also  found  In  this  study.  Namely,  reaction  times  were  longer 
when  dimensions  were  incongruent  than  when  the  dimensions  were  the 
same  or  when  there  was  no  relation  between  the  distensions. 

The  main  effect  of  modality,  adjusted  for  the  difference 
between  the  time  to  respond  between  the  speech  and  manual  devices, 
was  insignificant,  indicating  that,  overall,  manual  responses  did 
not  take  significantly  longer  than  the  speech  responses.  On  the 
other  hand,  when  subjects  were  required-  to  name  the  word,  the 
opportunity  to  make  a  speech  response  greatly  decreased  reaction 
times  compared  to  the  reaction  times  for  manual  responses,  as 
indicated  by  the  significant  Modality  by  Dimension  interaction. 
This  result  suggests  that  the  word  dimension  can  be  reported  more 
efficienty  by  a  speech  rather  than  a  manual  response. 

Last,  the  Modality  by  Dimension  by  Type  interaction  was 
significant.  An  examination  of  Figure  4  will  reveal  that  if 
subject s  made  a  speech  response  to  name  words  there  was  no 
difference  among  the  types  of  stimuli.  This  suggests  that  the 
rate  of  processing  the  word  dimension  is  so  fast  that  irrelevant 
dimension  cannot  have  its  impact  before  the  subject  responds. 
Apparently,  for  all  the  other  three  conditions,  by  contrast,  some 
experimental  manipulation  has  increased  the  processing  time  of  the 
relevant  dimension.  Specifically,  if  transforming  the  relevant 


dimension  from  a  verbal  code  Co  Che  appropriace  manual-key 
response  is  needed,  as  in  Che  manual  word  and  manual  ink 
condiCions,  Che  effecC  of  incongruenc  relations  occurs.  Likewise, 
transforming  Che  relevanc  dimension  from  Che  physical 
represencacion  of  Che  color  Co  Che  verbal  name  for  chac  color,  Che 
speech-ink  condicion,  also  produces  an  increase  in  Che  cime  Co 
respond  Co  Che  relevanc  dimension.  1c  is  only  when  che  response 
Co  a  relevanc  dimension  can  be  made  "uninhibited”  by  chese  type 
transformations  that  no  impact  of  Che  irrelevant  dimension  was 
seen.  Such  is  Che  case  in  Che  Speech-Word  condicion. 

With  regard  Co  accuracy  scores,  as  mentioned  before,  Che 
significance  of  che  effecC  found  indicates  only  chat  subjects' 
performance  decreased  directly  in  boCh  reaction  Cime  and  accuracy. 
Because  there  was  no  evidence  of  a  trade-off  between  speed  and 
accuracy,  Che  reaction  Cime  results  can  stand  unmodified. 

In  sum,  Che  findings  of  Chis  study  indicate  Chat  Che  amount 
of  interference  Chat  will  result  between  incongruenc  dimensions 
depends  on  both  how  much  Che  irrelevant  dimension  affects  che 
processing  cime  of  Che  relevanc  dimension  and  Che  response 
modallcy  used.  For  speech  responses  Co  words,  incongruency  has 
practically  no  effect  on  reaction  times,  but  for  speech  responses 
to  ink  color,  latencies  Co  lncongruent-dimension  stimuli  were 
longer  Chan  chose  Co  neuCral  and  congruenc  stimuli.  Manual 
reaction  times  for  boch  word  and  ink  color-relevant  dimensions 
were  longer  for  Incongruenc  Chan  for  congruenc  and  neucral. 


The  practical  message  of  these  results  for  the  use  of 
color-coded  words  is  that  there  may  be  no  benefit  to  using  the 
color  dimension  of  color-coded  words  if  subjects  must  respond 
quickly  to  the  word  dimension  by  speech.  If  a  color  of  a  word  Is 
Intended  as  a  redundant  code  but  a  speedy  response  to  the  word  is 
required,  then  the  redundancy  of  the  code  may  be  useless  because 
the  word  is  processed  and  responded  to  before  the  color  code  can 
be  processed.  Therefore,  the  code  Information  cannot  serve  Its 
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